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Harmonic Stability Analysis of the 2D Square and Hexagonal Bravais Lattices 
for a Finite— Ranged Repulsive Pair Potential. 
Consequence for a 2D System of Ultracold Composite Bosons. 

D.J. Papoular 1 ' 2 ^ 

1 Laboratoire de Physique Theorique et Modeles Statistiques, Universite Paris-Sud, 91405 Orsay, France 
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(Dated: June 26, 2008) 

We consider a classical, two-dimensional system of identical particles which interact via a finite- 
ranged, repulsive pair potential. We assume that the system is in a crystalline phase. We calculate 
the normal vibrational modes of a two-dimensional square Bravais lattice, first analytically within 
the nearest-neighbour approximation, and then numerically, relaxing the preceding hypothesis. We 
show that, in the harmonic approximation, the excitation of a transverse vibrational mode leads to 
the breakdown of the square lattice. We next study the case of the hexagonal Bravais lattice and 
we show that it can be stable with respect to lattice vibrations. We give a criterion determining 
whether or not it is stable in the nearest-neighbour approximation. Finally, we apply our results to 
a two-dimensional system of composite bosons and infer that the crystalline phase of such a system, 
if it exists, corresponds to a hexagonal lattice. 



PACS numbers: 63.22.-m, 64.70.. 



Introduction 
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Recent developments in atomic Physics, spanning the 
past decade, have made it possible to observe states of 
matter which, so far, had only been considered from a 
theoretical point of view. Bose-Einstein condensation, 
experimentally achieved in 1995 1,2 , is a landmark among 
these triumphs. More recently, much experimental effort 
has been directed towards the study of ultracold Fermi 
gases, allowing for instance an experimental study of the 
BEC — BCS crossover regime^. 

A stimulating new prospect for atomic physicists is the 
study of ultracold degenerate Fermi gases containing two 
different types of atomic species, such as 6 Li and 40 K. In 
such a gas, it is possible to tune the strength of the inter- 
action between the two species by varying the interspecies 
scattering length using a Feshbach resonance^. For a 
positive scattering length, bosonic dimers appear, con- 
taining one atom of each type^. Being in their highest- 
energy bound states, these composite bosons are stable 
with respect to collisional relaxation into deeper-bound 
states. Two-component degenerate Fermi gases have re- 
cently been obtained experimentally^, and interspecies 
Feshbach resonances have been identified 7 . 

If the difference between the two atomic masses is large 
enough, composite bosons interact via an effective pair 
potential which is repulsive. An expression for this pair 
potential has been derived in the Born-Oppenheimer 
approximation^. In the quasi-two-dimensional regime, 
this system has been shown to exhibit a crystalline phase 
for suitable values of the density and of the atomic mass 
ratirA 

In this work, we perform an analysis of the stability of 
the two-dimensional Bravais lattices with high symme- 
try properties, namely the square lattice and the hexago- 
nal lattice, with respect to classical harmonic vibrations. 



We use the nearest-neighbour approximation to derive 
analytic expressions for the dispersion relations of both 
lattices. We show that, in the case of a finite-ranged re- 
pulsive pair potential, the square lattice is unstable for 
all values of the density. Still in the nearest-neighbour 
approximation, we give a criterion determining the range 
of densities for which the hexagonal lattice is stable. In 
both cases, we present numerical results which show that 
taking into account more rings of neighbours does not 
affect the qualitative behaviour of the system. Apply- 
ing our results to a two-dimensional system of ultracold 
composite bosons, we infer that, for values of the mass 
ratio and density leading to a crystalline phase, the sys- 
tem crystallises into a hexagonal lattice. 



I. HARMONIC THEORY OF LATTICE 
VIBRATIONS FOR PARTICLES INTERACTING 
VIA A PAIR POTENTIAL 

For the sake of clarity, we first recall the general 
method^ for the calculation of the normal vibrational 
modes of a two-dimensional crystalline solid. 

We consider a two-dimensional system of identical par- 
ticles which we describe within the framework of classical 
mechanics. We assume that these particles interact only 
via a finite-ranged pair potential U(R), where R is the 
distance between two particles. We also assume that the 
system is in a crystalline phase corresponding to a two- 
dimensional Bravais lattice generated by two vectors a\ 
and ai\ at classical equilibrium, there is a particle at 
each lattice site r„ such that 



(1) 



where p = (j>\,p2) is a pair of integers. 

In order to characterise the stability of such a lattice, 
we shall study the propagation of lattice waves. For that 
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purpose we shall first write the Lagrangian of the sys- 
tem in the harmonic approximation, then derive from it 
the equations of motion, and finally look for plane-wave 
solutions to these equations. The lattice is stable if the 
frequencies of the normal modes thus found are all real; 
on the contrary, i. e. if there is at least one normal mode 
with an imaginary frequency, the lattice is unstable. 



A. Lagrangian of the crystal 



For a given wavevector fc, A(fe) is a real symmetric ma- 
trix. As such, it has two real orthogonal eigenvectors 
e (fe,i) an d £ (fc,2)- 



B. Equations of motion 

Using the translational invariance property of the 
A pq 's, the (classical) equation of motion for atom n, re- 
sulting from the Lagrangian reads: 



The total potential energy of the crystal is 
U tot ((u n )) = l£V(|r p + « p -r g -t 



,1), (2) 



where u n is the displacement of atom n from the corre- 
sponding lattice site r n , and the double sum over p and 
q spans all pairs of lattice sites. We expand U tot up to 
second order in the displacements u n . The constant term 
has no incidence on the dynamics of the crystal lattice 
and will therefore be dropped in subsequent calculations. 
The linear term cancels out when the double sum is per- 
formed. Consequently, the harmonic approximation to 
U tot is a quadratic function of the ((it n )): 



It, 



UpA^pql 



(3) 



where the real-space dynamical matrices A pq are real 2 x 
2 matrices defined by 9 -: 



pq 



d 2 U tot ((u n )) 



du l p du J q 



(4) 



O„=o) 



In the harmonic approximation, the Lagrangian of the 
crystal is thus: 



2 u p^pq u qi 

pq 



(5) 



where the first term is the total kinetic energy of the 
system and the second term is the harmonic approxima- 
tion to the total potential energy, m is the mass of each 
particle in the system. 

The A^'s are endowed with well-documented 
propertie s 9 ' 10 , among which tensor symmetry, invari- 
ance under spatial inversion, and invariance under lat- 
tice translations. Additionally, the following expression, 
valid if only pairwise interactions are considered, greatly 
simplifies their evaluation: 



a y _ _ 



d 2 U(\r p + u\) 



(6) 



We now introduce the momentum-space dynamical 
matrix A(fc), defined as the discrete Fourier transform 
of the Ao„ over the crystal lattice: 



A(fe) = A o P e ih r " = -2 £ Ao P sin 2 



2 kVp 



(7) 



p 



An 



(8) 



In the harmonic approximation, the motion of the par- 
ticles in the crystal is thus determined by a set of TV 
coupled linear equations similar to Equation [8j where N 
is the number of independent particles in the system. 

We now determine the normal vibrational modes of 
the system, i.e. we look for a plane-wave solution to the 
equations of motion : 



u n — A e exp i (fc • r n — wt) 



(9) 



where e is the polarisation of the mode, k is its wavevec- 
tor, and ig- is its frequency. A is an arbitrary complex 
number characterising the amplitude and global phase of 
the collective vibrational motion. Inserting Equation [S] 
into Equation [51 we obtain: 



: e = A(fe) e. 



(10) 



where A(fe) is the momentum-space dynamical matrix 
defined in Section II Al Equation [10] shows that for a 
given wavevector fc, there are two possible polarisations 
£(fe,i) and £(fe,2) which are the two eigenvectors of the 
dynamical matrix A(fc). The corresponding eigenvalues 
muj 2 (k) and mcj|(fc) yield their respectives frequencies 
LO\(k) and ui2(k). 

In the harmonic approximation, the classical dynam- 
ical properties of the crystal are thus completely deter- 
mined by the dynamical matrices A(fe). 



II. THE SPECIFIC CASE OF THE 2D SQUARE 
LATTICE FOR A PURELY REPULSIVE PAIR 
POTENTIAL 

We now apply the formalism summarised in Section [J 
to the specific case of the square Bravais lattice, gener- 
ated by two vectors a\ and a-i such that: 



|«i| = \a 2 \ = d and (01,02) 



7T 

2' 



(11) 



The wavevectors fc are most conveniently described in 
the reciprocal lattice basis (a*, a!) defined by a* ■ a,j — 
2ir ■ Sij . The reciprocal lattice of a square lattice is also 
a square lattice: 



^— and 

a 



(12) 
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A. Analytical expression for the dispersion relation 
in the nearest— neighbour approximation 

Wc first derive the expression for Ao p , where the lattice 
index p = (pi,p 2 ) € Z 2 , using Equation [5) 



A, 



Op 



r 2 
P 



p\ U"{r p ) +p 2 2 ^ PiP2 (U"(r p ) - 



(13) 



PlP2 



Next, the momentum-space dynamical matrix A(fe) 
can be calculated from Equation [7J An exact calcu- 
lation of A(fc) would require calculating an infinite se- 
ries spanning all sites of the two-dimensional Bravais 
lattice. However, assuming that the range of the pair 
potential U(R) is small compared to the lattice spac- 



ing d, the nearest-neighbour approximation can be used. 
The right-hand side of Equation [7J then reduces to a sum 
of five terms, corresponding to the reference lattice site 
p = (0, 0) and to its four nearest neighbours. Letting 
k = kia\ + /c 2 a 2 , we thus obtain the following expression 
for A(fe): 



A(Jfe) = 4 



U"{d) sin 2 (7rfci) 



U'(d) 
d 



sin 2 (7rfc 2 ) 







U'(d) 
d 





sin 2 (7rfci) + U"{d) sin 2 (7rfc 2 ) 



(14) 



In the nearest-neighbour approximation, A(fe) is a di- 
agonal matrix. According to the results of Section QJ the 
analytical expressions for the two (acoustic) branches of 
the dispersion relation can be read off the diagonal ele- 
ments of A(fe): 

imul{k) = 4 (ll"(d) sin 2 (7rA;i) + ^ sin 2 (7rfc 2 )) 

jmwf(fe) = 4 /^M s in 2 (7rfc 1 ) + U"{d) sin 2 (7rfc 2 )J 

(15) 

Because the dynamical matrix is diagonal, the allowed 
polarisations depend only on the branch of the dispersion 
relation that is considered (they do not depend on the 
wavevector). The first branch — w 2 (fe) — corresponds 
to the polarisation e-y = t^t, whereas the second branch 

— w|(fc) — corresponds to the polarisation e 2 = j^fj ■ 

Equation[l5]is compatible with the four-fold symmetry 
of the two-dimensional square lattice. Indeed, let k' be 
the image of k under the vector rotation of angle ^: k' = 
—k 2 a\ + k ± a 2 *. Equation [T5] yields oj\{k') = uf(fc) an d 
W |(fc') = 

B. Instability of the square lattice for a purely 
repulsive pair potential 

In the harmonic approximation, a crystal lattice is sta- 
ble if lattice waves can propagate through the crystal for 



all wavevectors fc in the first Brillouin zone of the lattice. 
We now show that this is not the case for the square 
lattice if the pair potential is purely repulsive. 

Nearest-neighbour approximation. Let us consider a 
wavevector lying along a\: k — k\a\ . Equations 1151 
reduce to: 

mw 2 (fc) = 4£/"(d)sin 2 ( 7 rfc 1 ) 
m4(k)= 4^sin 2 ( 7 rfc 1 ) ' " 

For a purely repulsive potential, U'(d) < for all possi- 
ble values of the lattice spacing d. Consequently, uj\ is 
negative, and therefore the frequency of the normal mode 
with wavevector k = k\a\ and polarisation £ 2 is not de- 
fined. Physically, this means that the propagation of a 
transverse normal mode (i.e. a normal mode with k _L s) 
with a wavevector along a\ would break the crystal lat- 
tice. Because of the four-fold symmetry of the square 
lattice, the same results and conclusions are valid for a 
transverse mode with a wavevector along a 2 . 

Consequently, in the particular case of a purely repul- 
sive pair potential, the two-dimensional square lattice is 
not stable. 

The variations of Lo\(k) and w|(fc), in the nearest- 
neighbour approximation [i.e. as given by the analytical 
expressions [16]) , are represented in Figure [T] for wavevec- 
tors k whose tips lie on the high-symmetry axes of the 
Brillouin zoneii, in the case of the pair potential char- 
acterising the two-dimensional interactions of composite 
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FIG. 1: Left: Brillouin zone of the square Bravais lattice, 
with the high-symmetry points r(0, 0), X(\, 0), and M{\, \). 
Right: the two branches ui\(k) (solid lines) andoifCs) (dashed 
lines) of the dispersion relation of a two-dimensional square 
lattice, for wavevectors k with origin Y and whose tips lie 
on the Y-X-M-T path represented in red on the diagram 
on the left. The pair potential is the one characterising the 
interaction of two composite bosons in the two-dimensional 
case. The lattice spacing is d — 2.0 in units of the composite- 
boson molecular size. The total mass m of the composite 
bosons is taken to be unity. The blue graphs correspond to 
the analytical result in the nearest-neighbour approximation; 
the red graphs are numerical results taking into account five 
rings of neighbours. Note the lifting of the u)i j2 (fc) degeneracy 
along the M-Y branch as soon as next-nearest neighbours are 
taken into account. 



bosons at temperature T = OK®. The branch wf(fe) is 
negative for all wavevectors along a* (T—X part of the 
plot of uj 2 (k)). 

Numerical results including more distant neighbours. 
In order to go beyond the nearest-neighbour approxima- 
tion, we have performed numerical calculations including 
more distant neighbours. For that purpose we have writ- 
ten a Python program which evaluates the lattice sums 
involved in Equation [7] for a finite-sized square lattice 
with 100 particles in both the a\ and directions. The 
pair potential is finite ranged, and the numerical results 
for uf(k) and w|(fc) therefore converge quickly as a func- 
tion of the radius of the disk of neighbours taken into ac- 
count. The results of these calculations are represented 
in Figure [TJ The branch o;|(fe) remains negative for k 
vectors along a*. Consequently, the effect described in 
the preceding paragraph is not an artefact due to the 
nearest-neighbour approximation: in the particular case 
of a purely repulsive pair potential, and in the harmonic 
approximation, the two-dimensional square lattice is un- 
stable. 

Geometrical interpretation of the instability. Let us 
consider the transverse vibrational mode with polarisa- 
tion £i and wavevector \a* 2 . Equation [9] shows that the 
displacement of atom n — (71.1,77,2) from the correspond- 
ing lattice site is (omitting the time dependence e luJlt ): 



u, 



= Ae 1 -(-iy 



(17) 



We shall consider the case of a small amplitude A. The 
positions of the particles for a lattice which is at rest 
on the one hand, and when the mode described above 



is excited on the other hand, are compared on Figure [2] 
In the absence of vibrations, the distance of atom p to 
its four nearest neighbours p±, P2, P3, and p^ is exactly 
equal to the lattice spacing d (left-hand side of the fig- 
ure). The mode described above modifies the distances 
between atom p and some of its neighbours. The dis- 
tance between p and p\ remains unchanged [i.e. equal 
to d), as well as the one between p and p^; however, 
the distance between p and pi, as well as the one be- 
tween p and pi, are increased to d (l + ~p^- All four 

distances are increased (or remain unchanged), and the 
pair potential is repulsive, therefore the total interaction 
energy between atom p and its four nearest neighbours 
is decreased. The slightly distorted lattice represented 
on the right-hand side of Figure [5] therefore has a lower 
potential energy than the square lattice represented on 
the left-hand side, which entails that the square lattice 
is not a stable equilibrium position. 



III. THE CASE OF THE 2D HEXAGONAL 
BRAVAIS LATTICE 

In Section [TTJ we showed that, within the framework of 
the harmonic approximation for crystal vibrations, the 
two-dimensional square Bravais lattice is not stable. In 
the present section, we apply the same formalism to the 
two-dimensional hexagonal lattice and show that, in con- 
trast with the former, the latter is stable in the harmonic 
approximation. 

The two-dimensional hexagonal Bravais lattice is gen- 
erated by two vectors a\ and <22 such that: 

2-7T 

|oi| = |o2|=d and (oiTajj) = — . (18) 

o 

As for the square lattice, we introduce the reciprocal lat- 



tice basis (a*, Ojj), defined as before by a* ■ aj 



The 



reciprocal lattice of a hexagonal lattice is also a hexago- 
nal lattice: 

271" 2 7T 

Kl = Kl = and ( a i' a 2)=3- ( 19 ) 

Dispersion relation. Equation [S] yields the following 
expression for Aq p , where p — (pi,P2) € Z 2 : 



P2 

T 



P3- 

a 2 



pi 



small 



lattice distortion 



ai 



P2 

CM 'M CA 

321 

cm - -*e* cm 
ai 



FIG. 2: Distortion of the crystal lattice due to the transverse 
vibrational mode with polarisation £1 and wavevector k = 
hat 
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' (2 Pl - p 2 f U"(r p ) + Z V \ ^ V3 P2 (2 Pl - p 2 ) (U"(r p ) - ^) 
V3p 2 (2 Pl -p 2 ) {U"{r p ) - 3pf U"{r p ) + (2 Pl -p 2 ) 2 ^l _ 

Using Equation [7] in the nearest-neighbour approximation, we then derive the expression for A(fc): 
A(k) = \ 4U "( d >i + WW + 3 ^)( s 2 + «§) V3(tf"(d) - - 4) 



A 



Op 



1<F 

4f2 



where si = sin(ifc-ai), s 2 = sin(ifc-a2), and S3 = 
sin (ife • (ai + 02)). Equation[2"Tl yields the following ap- 
proximate analytical expression for the two branches of 
the dispersion relation, which are obtained as the two 
eigenvalues of A(fc): 



mu>l 2 {k) = 2 U"{d) + 



U'{d) 



(4 + 4 + 4) 



± 2 U"(d) 



U'{d) 



(22) 



where Sn 



+ S |) 2 -3( S 2 S 2 +S 2 S 3 + 



S 3 S l) 



Equation [22] is symmetrical in s\, s 2 , and S3, and is 
thus compatible with the six-fold symmetry of the two- 
dimensional hexagonal lattice. 

The polarisations corresponding to uj\. 2 are £1,2 = 
£i2 e a: + £ i2 e yj where (e x ,e y ) is the two-dimensional 
direct orthonormal basis with e x along a\, and 



'1,2 



\k) 
\k) 



-sir 

(2s 



if 



(23) 



3(s 



2 + (2s 



The frequencies u}\^ 2 {k) of the normal vibrational modes 
depend on the first and second derivatives of the pair po- 
tential, whereas the corresponding polarisations are in- 
dependent of the particular shape U(x) of this potential. 
However, in contrast to the case of the square lattice, the 
polarisations £1.2 (fc) for the hexagonal lattice do depend 
on the considered wavevector k. 

The variations of uj\ 2 (k) are represented in Figure[3]in 
the case of the pair potential characterising the interac- 
tion of two composite bosons in the fully two-dimensional 
situation 8 , for wavevectors k whose tips lie on the high- 
symmetry axes of the Brillouin zoneii. The analytical 
results obtained in the nearest-neighbour approximation 
(Equation I22p are compared to numerical calculations 
taking into account five rings of neighbours on a finite- 
sized hexagonal lattice with 100 independent particles in 
both the a\ and a 2 directions. Both calculations have 
been performed for the lattice parameter d = 2.0 (in 
units of the composite-boson molecular size). In both 
cases, the two branches lo\ 2 (fc) of the dispersion relation 
are positive for all wavevectors k in the Brillouin zone. 
Consequently, contrary to the results presented in Sec- 
tion III Bl for the square Bravais lattice, there is a range 




Nearest neighbours 
5 rings of neighbours 




FIG. 3: Left: Brillouin zone of the two-dimensional hexag- 
onal Bravais lattice, with the high-symmetry points F(0,0), 
M(|,0), and K(^,^). Right: the two branches wi^fe) 2 of 
the dispersion relation for the hexagonal lattice, for wavevec- 
tors k with origin F and whose tips lie on the T—M—K—T 
path represented in red on the diagram on the left. The pair 
potential is the one characterising the interaction of two com- 
posite bosons in the two-dimensional case. The blue graphs 
correspond to the analytical result in the nearest-neighbour 
approximation; the red graphs are numerical results taking 
into account five rings of neighbours. As in Figure [1] the lat- 
tice spacing is d = 2.0 and the total mass is m = 1, in the 
same units. 



of densities p for which the two-dimensional hexagonal 
Bravais lattice of composite bosons is stable with respect 
to harmonic lattice vibrations. 

Stability criterion for the hexagonal lattice. We now 
derive, in the nearest-neighbour approximation, a sim- 
ple criterion on the relative values of U"(d) and U'(d)/d 
determining whether the hexagonal lattice is stable or 
not. 

A two-dimensional hexagonal Bravais lattice with a 
given lattice spacing d {i.e. a given density p = ^2^/3 ) 
is stable with respect to (harmonic) vibrations if the fre- 
quencies of all normal modes are real. Using Equation 
|22| and assuming U'(d) < (repulsive potential), the 
stability condition becomes: 



U"(d) 
-U'(d)/d 



(4 + 4 + 4 + v4) > (4 + 4 + 4- v4) 



(24) 



for all k in the Brillouin zone and r) = ±1. Noting that 



< sf + s| + s| 



4 < 4 



4 + 4 + s 6> ^e preceding 
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condition can be rewritten as: 



U"{d) 

-U'(d)/d ~ feeBZ si + s 



> max 



si + s 2 n 



(25) 



An analysis of the function of k on the right-hand side 
of Equation [25] shows that the sought maximum is 3, 
and that it is achieved for all wavevectors lying along 
the a*, o|, or (a| — a*) axes of the Brillouin zone (cf. 
Figure [3]). The locus of the maximum is thus compatible 
with the six-fold symmetry of the reciprocal lattice. The 
preceding inequality therefore reduces to: 



U"(d) 
-U'{d)/d 



> 3. 



(26) 



For a given repulsive pair potential U(x), Equationl2"6"ldc- 
termines the values of the density p for which the hexag- 
onal Bravais lattice is stable with respect to harmonic 
vibrations, in the nearest-neighbour approximation. 



IV. CONSEQUENCE FOR THE 
TWO-DIMENSIONAL CRYSTAL OF 
COMPOSITE BOSONS 

We now a consider a two-dimensional system of com- 
posite bosons obtained in an ultracold mixture containing 
two different types of Fermionic atoms. These compos- 
ite bosons interact via an effective pair potential which 
is purely repulsive. An analytic expression for this pair 
potential has been derived in the Born-Oppenheimer ap- 
proximation: 

U 2 b(R) = U q -[k R K {k R) KxiKoR) - K 2 (k R)] (27) 

where Ko and Ki are Bessel functions, Uq is a constant, 
and Kq" 1 is the composite-boson molecular size. This 
system has been shown to exhibit a crystalline phase if 
the ratio of the two different atomic masses is sufficiently 
large^. The results presented in Sections [IT] and IIIII pro- 
vide a simple argument as to which two-dimensional lat- 
tice, if any, the system crystallises into. 

This ultracold system of composite bosons cannot be 
completely described using classical mechanics. Indeed, 
the particles in the system are not at rest, even at 
T = OK: their positions exhibit quantum zero-point 
fluctuations. However, if the system is in a crystalline 
phase, this zero-point motion can be interpreted as a vi- 
bration of the particles around the corresponding lattice 
sites. Therefore, this (quantum) crystal can only be sta- 
ble if the corresponding crystal lattice is stable from a 
classical point of view. 

There are five types of two-dimensional Bravais 
lattices^. Among these, only two exhibit high symmetry 
properties: the square lattice (four-fold symmetry) and 
the hexagonal lattice (six-fold symmetry) . The unit cells 
of both of these lattices are represented in Figure [U 

All particles in the system are identical (they are all 
composite bosons). It is therefore reasonable to assume 



a 2 



ai 

Square 



aA 2n 

V 



ai 

Hexagonal 



FIG. 4: Direct-lattice bases of the two 2D Bravais lattices 
with high symmetry properties: the square lattice (four-fold 
symmetry) and the hexagonal lattice (six-fold symmetry). 



that its crystal phase will be highly symmetrical, and 
thus that the system crystallises in either the square 
lattice or the hexagonal lattice. However, the interac- 
tion between two composite bosons is characterised by 
a pair potential which is repulsive for all relative dis- 
tances. Therefore, the results of Section ["II Bl imply that 
the square lattice is not a stable equilibrium position for 
this system. Consequently, for values of the mass ratio 
and density leading to a crystalline phase, the system 
will crystallise in a hexagonal lattice. This prediction is 
confirmed by Quantum Monte Carlo calculations 8 . 

The range of densities for which the hexagonal lattice is 
stable is determined, in the nearest-neighbour (NN) ap- 
proximation, by the criterion stated in Section IIIII The 



relevant function 



U"(d) 



is represented in Figure [5] in 



-U'(d)/d 

the case of the pair potential [27] (left-hand plot). The 
criterion for stability (Equation |2"6"]) is satisfied for all 
densities lower than p^ax = 0.31. For p > p^ x , nei- 
ther the square lattice nor the hexagonal lattice are sta- 
ble in the nearest-neighbour approximation. Numerical 
calculations of /o max taking into account farther rings of 
neighbours on a 100 x 100 hexagonal lattice (Figure [5] 
right-hand plot) show that the corrections due to the 
next neighbours do not affect the qualitative behaviour 
of the system: starting from the eighth ring of neigh- 
bours, the critical density saturates to p max = 0.499(1). 
We therefore predict that, for densities greater than p max , 
the system can exhibit no crystalline phase: it is in a dis- 
ordered phase regardless of the value of the mass ratio. 

Note that the numerical value of p max that has just 
been obtained must be considered with caution, since the 
expression of the pair potential U^d (Equation [27]) that 
has been used to derive it results from approximations 
that may not be strictly valid in the present case. Never- 
theless, it remains straightforward, using our suggested 
procedure, to confirm the existence of a critical density, 
and possibly refine its value given a more accurate pair 
potential. 



Discussion 

Observability. The composite bosons are obtained in 
a trapped bipartite Fermi mixture which has been cooled 
to degeneracy. The quasi-two-dimensional regime can be 
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0.2 0.31 0.4 0.6 5 10 15 



P # of rings of neighbours 

FIG. 5: Stability of the hexagonal lattice in the case of 
the pair potential between composite bosons. Left: plot of 
-c/'ff/d as a function of the density p = 55771 • In the nearest- 
neighbour approximation, the hexagonal lattice is stable for 
-u'(d)/d 3) *- e - f° r P < Pmax = 0.31. Right: critical den- 
sity pmax above which the hexagonal lattice is not stable, as 
a function of the number of rings of neighbours taken into ac- 
count. Starting from the eighth ring of neighbours the critical 
density saturates to p max = 0.499(1). As in Figures [T] and [3] 
the unit of length is the composite-boson molecular size Kq 1 - 



reached by confining both types of atoms to the antinodes 
of an optical lattice. The crystalline or liquid phase of the 
composite boson system may be characterised through 
absorption-imaging techniques'^. 

Applicability. General theorems^ have been stated, 
concerning a specific — albeit large — class of pair 
potentials, which imply that no crystalline order can 
be observed in infinite two-dimensional systems. How- 
ever, the composite-boson systems conceivable in exper- 
iments are trapped, and hence finite-sized, systems, to 
which these theorems do not apply, regardless of the 
specific shape of the pair potential^. The experimen- 
tal observation of a two-dimensional crystalline phase of 
composite bosons will therefore not contradict the theo- 
rems mentioned above. Furthermore, hexagonal lattices 
have already been observed in numerous other systems, 
such as vortices in superconductors^ and rotating Bosc- 
Einstein condensates^, Ceo molecules on a substrate^, 
and colloidal suspensions 1 -. In all four preceding cases, 
the observed two-dimensional lattice is the hexagonal 



one, which corresponds to our present prediction for the 
composite-boson system. 



Conclusion 

The interactions of composite bosons in a two- 
dimensional ultracold system are remarkable inasmuch 
as they are described by a finite-ranged repulsive pair 
potential. In this context, we have shown the square 
Bravais lattice to be unstable with respect to harmonic 
vibrations, first through an analytic expression of its dis- 
persion relation derived using the nearest-neighbour ap- 
proximation, and then through numerical calculations 
taking into account farther rings of neighbours. Again 
using the nearest-neighbour approximation, we have de- 
rived an analytic expression of the dispersion relation for 
the hexagonal lattice. We have stated a criterion de- 
termining the range of densities for which this lattice is 
stable. In the particular case of the interaction between 
composite bosons, this criterion yields a maximum den- 
sity above which no crystalline phase can be observed. 
Numerical calculations have shown that taking into ac- 
count farther rings of neighbours does not qualitatively 
change the behaviour of the system. We thus conclude 
that, for all values of the density and mass ratio yield- 
ing a crystalline phase, the system of composite bosons 
crystallises into the hexagonal lattice. 
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